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METHOD, SYSTEM AND SOFTWARE FOR JOURNALING SYSTEM OBJECTS 

Field of Invention 

5 The present invention relates to a method, system and software for joumaling creation, 
change and deletion of system objects. More particularly, but not exclusively, the 
present invention relates to a method, system and software for journaling changes to 
general OS/400 system objects (including program objects, configuration objects, 
queues and space/memory mapped objects) in order to replicate these changes on the 
10 same or a remote system. 

Background to the Invention 

The IBM OS/400 operating system provides journaling of database changes via 
integrated system functions. This journaling function is primarily orientated toward 

15 recording database record level changes for system recovery, commitment control (e.g. 
to ensure transaction boundaries), auditing, and to support the replay of changes to a 
replica database (remote or local). Other system objects, such as programs and 
configuration objects, are not supported by the database journaling function. For these 
other system objects an independent System Audit Journal is maintained. The creation, 

20 deletion and changing of system objects may be recorded in the Audit Journal for the 
primary purpose of providing an audit of activity related to these objects. When viewed 
with the intention of providing replication of these objects to a remote or local (copy) the 
Audit Journal has several significant drawbacks, namely: 

1 . The Audit Journal entries are deposited and made available to other processes 
25 on the system only after the associated object activity has been performed. 

There is no way of trapping the object activity "as-it-happens". This makes 
additional processing of the object by another system process difficult since the 
process, which is performing the object activity, is likely to lock and/or use the 
object before the related Audit Journal entry can be obtained by some 
30 monitoring process. 

2. The Audit Journal entries are "system-wide" - there is one journal for all objects 
on the entire system. This requires any monitoring process to retrieve all of the 
journal entries even if only a small subset is required for replication. 
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3 jhe Audit Journal entries do not contain enough information to perform the 
associated object activity on another system (or local copy). This requires that 
any monitoring process must attempt to locate and lock the associated object in 
an attempt to make a copy prior to another change being performed on the 
5 object. If a copy can not be made of the exact state of the object, this state is 

"lost" and a replication process will be unable to provide the correct object state 
to a remote (or local copy) system. 

4. The only way to serialise Audit Journal entries with a database journal is to 
attempt to use the journal entry timestamps to merge the Audit Journal entries 
io with the associated database journal entries. This can cause significant 

overhead in processing the entries for replication. Additionally, when a system 
has multi-processors the timestamps contained in independent journals may not 
accurately reflect the exact sequence of operations. 



15 Given these drawbacks, a foolproof method of synchronising system object changes 
with associated database changes using the Audit Journal has not been available. A 
method of capturing the content and state of system objects using the same database 
journal as is used to capture the actual database record level changes would ensure 
that the database and object changes could be replicated accurately to a remote (or 

20 local copy) system. 

Since OS/400 system objects are created, changed, and deleted using a standard 
(finite) set of commands, the most obvious solution to obtaining state information (or 
making a copy of an object) is to provide replacement commands or to implement a 
25 command exit program. There are significant drawbacks to both of these approaches 

The replacement system commands approach has the following drawbacks: 

1 . System command parameter interfaces to the associated OS/400 command 
processing programs can (and often do) change with each release of OS/400. This 

30 would cause significant dependency between the replication software and a given 

release of OS/400. 

2. The number and complexity of the commands that would need to be replaced is 
high (over 150 commands, several with nested lists of parameters). Each command 
would need it's own replacement processing program as well as significant effort to 
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ensure that each parameter is processed correctly (e.g. as it would be by the 
original OS/400 command). 

The command exit point program approach has the following drawbacks: 
5 1 . Neither of the two registered exit points provided by OS/400 allow the associated 
exit program to be activated after the command has been executed. Therefore, in 
the case of object creation, change, deletion commands, the exit program is unable 
to process the resulting object. 
2. The QIBM_QCA_CHG_COMMAND exit point is also limited as to the number of 
10 exit programs that can be registered. This could prevent some customers from 

using this exit point if other software uses the exit point. 

It is an object of the present invention to provide a method, system and software for 
journaling system objects which overcomes the above drawbacks or to at least provide 
15 the public with a useful choice. 

Summary of the Invention 

According to a first aspect of the invention there is provided a method of journaling 
20 changes to system objects including the steps of: 

i) substituting a dummy function for a system function; 

ii) executing the system function under operation of the dummy function; 

iii) generating copies of system objects, changed by execution of the system function, 
for journaling; and 

25 iv) completing execution of the dummy function. 

The dummy function may substitute the system function by having a duplicate calling 
name, and pre-empting the execution of the system function. 

30 An exit point may be associated with the dummy function and an exit program may be 
registered for the exit point so that during operation of the dummy function the exit 
program may be executed. 

The exit program may handle execution of the system function and capture changes to 
35 system objects occurring during such execution. Copies of the changes are generated 
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by the exit program and may be saved to disk or streamed directly to a database 
system for journaling. 

Alternatively, the exit program may be used to retrieve a command string for the 
5 system function and transmit this back to the dummy function. The dummy function 
may then handle execution of the system function and capture changes to system 
objects occurring during such execution. In such a case, copies of the changes are 
generated by the dummy function. 

10 Preferably, the dummy function includes a replacement command and a replacement 
command processing program. 

The database system may be incorporated with a replication system and may replicate 
the changes to other local or remote databases. 

15 

Messages or exceptions generated by the system function may be captured into a 
queue. 

The dummy function may complete execution by forwarding any messages or 
20 exceptions generated by the system function back to the process which called the 
system function. 

The system objects include program objects, configuration objects, queues and 
space/memory mapped objects. 

25 

Changes to system objects include creation, change, and deletion of system objects. 

Preferably the system functions are those found on an OS/400 processor. 

30 According to a further aspect of the invention there is provided a method of journaling 
changes to system objects including the steps of: 

i) executing a system function during which changes to system objects occur; and 

ii) journaling changes to system objects during execution of the system function. 
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One way that changes to system objects may be journalecl during execution of the 
system function is by integrating journaling commands into the code of the system 
functions. 

5 Another way that changes to system objects may be joumaled during execution of the 
system function is by associating exit points with the system function so that during 
execution of the system function an exit program may be called to journal the system 
objects. 

10 According to a further aspect of the invention there is provided a system for journaling 
changes to system objects including: 

i) a processor adapted to execute a dummy function in place of a system function 
wherein the dummy function executes the system function and generates copies of 
system objects resulting from system function execution for journaling; and 
15 ii) memory for use by the processor during execution. 

Preferably the processor is an AS/400 processor. 

According to a further aspect of the invention there is provided software for effecting 
20 the method of the first and second aspects of the invention. 

Brief Description of the Drawing 

25 The invention will now be described by way of example with reference to the 
accompanying drawing in which: 

Figure 1: shows an illustration of object journaling in relation to a OS/400 Class 
object. 

30 

Figure 2: shows an illustration of an alternative embodiment of the invention. 
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Detailed Description of Preferred Embodiments 

The following description describes a system object journaling method operating under 
the OS/400 operating system. It will be appreciated that the method is applicable to 
5 other systems with appropriate modifications. 

The method uses a combination approach to achieve the desired result; significantly 
reducing the drawbacks associated with any single approach. 

10 A summary of the steps of the method follows: 

i. An exact duplicate of each OS/400 command associated with object changes 
is made into a new library. 

ii. The command processing program of each duplicate command is changed to a 
15 common supplier provided program which does not need to process any of the 

command parameters (and therefore is not affected by command parameter 
changes). 

iii. A QiBM_QCA_RTV_COMMAND exit point program is registered for each 
(duplicate) command in the new library. This means that the exit program will 

20 be called before the associated Command Processing Program (e.g. the 

program specified in step ii). 

iv. The new command library is placed in the system library search list, above the 
normal OS/400 system library (QSYS). This causes normal system users and 
application programs to invoke the commands from the new library rather than 

25 their counterparts in the OS/400 system library (QSYS). 

v. The exit point program uses the passed command string, to execute the 
specified command using the original OS/400 command (in the OS/400 system 
library). The exit point program is then able to perform it's own processing (to 
capture the object changes) after the OS/400 command has been executed. 

30 Any messages sent by the OS/400 command to the exit point program are 

stored in a temporary queue so that they may be "resenf to the original 
requestor (e.g. the user and/or application program which submitted the 
command). 
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vi. The replacement (duplicate) Command Processing Program is then called by 
OS/400 (when the exit point program has completed). The common 
(replacement) Command Processing Program simply resends any messages 
contained in the temporary queue (placed there in step v). 

5 

In an alternative embodiment of the method steps v and vi may be replaced with: 

v. The exit point program passes the command string, using a data queue, to 
the replacement (duplicate) Command Processing Program. 

vi. The replacement (duplicate) Command Processing Program executes the 
10 specified command using the original OS/400 command (in the OS/400 

system library). The (replacement) Command Processing Program, is then 
able to perform it's own processing (to capture the object changes) after the 
OS/400 command has been executed. Any messages sent by the OS/400 
command to the (replacement) Command Processing Program are stored in 
15 a temporary queue and "resent" to the original requestor. 



The method eliminates the need for a custom replacement command processing 
program for each duplicated command - a single, common program is used for each 
command. The use of the duplicate version of the commands to attach the exit point 
program, allows the exit point program (or the replacement Command Processing 
20 Program in the alternative embodiment) to control the processing of the actual system 
command - performing replication activities both before and after the associated object 
is created/changed/deleted. 



Referring to Figure 1, the invention will be described in relation to journaling of a 
25 system object on a primary system for replication to a remote journal where the change 
to the system object is the creation of a OS/400 Class object by a user application and 
where an exit point program is used to control the processing of the actual system 
command. 



30 



The user application 1 runs with a system library search list 2 that places 3 the 
duplicate command library 4 (MAXSYS) above the operating system command library 
5 (QSYS). 
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This causes the unqualified CRTCLS (Create Class Description) command 6 to bind 7 
to the MAXSYS library version 4 of the command at run-time. 

The replication program MXIICARTET 8 is registered as an exit program (using the 
5 system defined Q I B M_QC A_RTV_C OM MAN D exit point 9) for the MAXSYS version of 
the CRTCLS command. This causes the MXIICARTET program 8 to be called 10 
BEFORE the command's Command Processing Program 1 1 is called. The exit point 
interface passes the full command string text, as specified by the user application, to 
the exit program 8. 

10 

The exit program 8 performs any required pre-processing to determine if the 
associated object is defined for replication. The system version of the specified 
command 12 (in this case, the CRTCLS command) is executed 13 by the 
MXIICARTET program 8 and any messages generated 14 by the system command are 
15 stored in a temporary queue 15. 

The affected object 16 (the new class description in this example) is saved 17 to a 
temporary save file by the MXIICARTET program. 

20 The temporary save file is then copied 18 to a temporary OS/400 Integrated File 

System (IFS) stream file 19 which is journaled to the journal 20 used by the associated 
replication configuration (e.g. the same journal as used for the database files defined 
for replication). This effectively stores the save image into the journal. 

25 The generated journal data is then transmitted 21 to the remote system(s) for 
replication using the standard OS/400 remote journal support. 

The MXIICARTET program then returns control to its caller 9 (the system exit point), 
which then calls 22 the Command Processing Program (for the CRTCLS command in 
30 the MAXSYS library). For each command in the MAXSYS library, the Command 
Processing Program is MXCPPNULL 10. 
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The MXCPPNULL program 10 retrieves 23 the messages stored in the temporary 15 
queue (by the MXIICARTET program), that were generated by the standard system 
version 12 of the command, and sends 24 them to the user application 1. This allows 
the user application 1 to process the messages exactly as if it had called the system 
5 version of the command directly. 

Referring to Figure 2, the invention will be described in relation to journaling of a 
system object on a primary system for replication to a remote journal where the change 
to the system object is the creation of a OS/400 Class object by a user application and 
10 where a replacement Command Processing Program is used to control the processing 
of the actual system command. 

The user application 25 runs with a system library search list 26 that places 27 the 
duplicate command library 28 (MAXSYS) above the operating system command library 
15 29 (QSYS). 

This causes the unqualified CRTCLS (Create Class Description) command 30 to bind 
31 to the MAXSYS library version 28 of the command at run-time. 

20 The replication program MXIICARTET 32 is registered as an exit program (using the 
system defined Q I BM_QCA_RTV_COMMAN D exit point 33) for the MAXSYS version 
of the CRTCLS command. This causes the MXIICARTET program 32 to be called 34 
BEFORE the command's Command Processing Program 35 is called. The exit point 
interface passes the full command string text, as specified by the user application, to 

25 the exit program 32. 

The exit program passes the full command string through a data queue 36 to the 
Command Processing Program (for the CRTCLS command in the MAXSYS library). 
For each command in the MAXSYS library, the Command Processing Program is 
30 MXCPPNULL 35. 

The MXIICARTET program 32 then returns control to its caller 33 (the system exit 
point), and the MXCPPNULL 35 program is executed. 
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The MXCPPNULL 35 program performs any required pre-processing to determine if 
the associated object is defined for replication. The full command string is extracted 
from the data queue 36 and the system version of the specified command 37 (in this 
case, the CRTCLS command) is executed 38 by the MXCPPNULL program 35 and 
5 any messages generated 39 by the system command are stored in a temporary queue 
40. 

The affected object 41 (the new class description in this example) is saved 42 to a 
temporary save file by the MXCPPNULL program 35. 

10 

The temporary save file is then copied 43 to a temporary OS/400 Integrated File 
System (IFS) stream file 44 which is journaled to the journal 45 used by the associated 
replication configuration (e.g. the same journal as used for the database files defined 
for replication). This effectively stores the save image into the journal. 

15 

The generated journal data is then transmitted 46 to the remote system(s) for 
replication using the standard OS/400 remote journal support. 

The MXCPPNULL program 35 retrieves 47 the messages stored in the temporary 40 
20 queue, that were generated by the standard system version 37 of the command, and 
sends 48 them to the user application 25. This allows the user application 25 to 
process the messages exactly as if it had called the system version of the command 
directly. 

25 Definitions 

Class (Class Description) An object that identifies the run attributes of a job. 

Command A statement used to request a function of the system. A 

command consists of the command name abbreviation, 
which identifies the requested function, and its parameters. 



Command Processing A program that processes a command. This program 

Program (CPP) performs some validity checking and processes the 
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command so that the requested function is performed. 



Exit Program 



1 . A user-written program that is given control during 
operation of a system function. 

2. A program to which control is passed from an exit point. 



Save File 



A file allocated in auxiliary storage that can be used to store 
saved data on disk (without requiring diskettes or tapes). 



System Audit Journal 



A journal used by the system to keep a record of security- 
relevant events that occur. 



While the present invention has been illustrated by the description of the embodiments 
thereof, and while the embodiments have been described in considerable detail, it is 
not the intention of the applicant to restrict or in any way limit the scope of the 
5 appended claims to such detail. Additional advantages and modifications will readily 
appear to those skilled in the art. Therefore, the invention in its broader aspects is not 
limited to the specific details representative apparatus and method, and illustrative 
examples shown and described. Accordingly, departures may be made from such 
details without departure from the spirit or scope of applicant's general inventive 
10 concept. 



